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Abstract 



The concept of a visible point of a convex set relative to a given point is introduced. 
A number of basic properties of such visible point sets is developed. In particular, it is 
shown that this concept is useful in the study of best approximation, and it also seems 
i 1 to have potential value in the study of robotics. 
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1 Introduction 

> 

i Unless explicitly stated otherwise, throughout this paper X will always denote a (real) 

normed linear space, and C a closed convex set in X. For any two distinct points x, v in X, 
t-h we define interval notation analogous to that on the real line by 

(N 
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X 
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= {Ax + 
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-X)v 


< A < 1} 
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-X)v 


< A < 1} 


X, 
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= {Ax + 
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-X)v 


< A < 1} 


X, 


«[: 


= {Ax + 


(1 


-X)v 


< A < 1} 



In other words, [x,v] is just the closed line segment joining x and v, [x,v[ is the same line 
segment but excluding the end point v, and ]x,v[ is the line segment [x,v] with both end 
points x and v excluded. 
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Definition 1.1 Let x G X . A point v G C is said to be visible to x with respect to C if 
and only if [x, v] fl C — {v} or, equivalently, \x,v[C\ C — 0. The set of all visible points to x 
with respect to C is denoted by Vo(x). 



Thus 



v c (x) = {v g c | [x,v]nc= {v}} = {v g c I [x,v[nc = 0}. 

=dlv. one can reeard Vn(x\ as the "lieht" that would be cast ( 



'i.r 



Geometrically, one can regard Vc(x) as the "light" that would be cast on the set C if 
there were a light source at the point x emanating in all directions. Alternatively, one can 
regard the set C as an "obstacle" in X, a "robot" is located at a point x G X, and the 
directions determined by the intervals [x,v], where v G Vc(x), as directions to be avoided by 
the robot so as not to collide with the obstacle C. 

In this paper we begin a study of visible sets. In Section |2j we will give some character- 
izations of visible sets (see Lemmas 2.3 and 2.9, and Theorem 2.14 below). We show that 



the visible set mapping Vc satisfies a translation property just like the well-known metric 



projection Pc (see Lemma 2.5 below). Recall that the generally set- valued metric projection 
(or nearest point mapping) Pc is defined on X by 



P c {x) :={yeC 



\x 



y\ 



inf I 



x 



Those closed convex sets C such that the set of visible points to each point not in C is 
the whole set C are precisely the affine sets (Theorem 2.6). In Section [3] we study the 



connection between visible points and best approximations. Finally, in Section [4] we consider 
characterizing best approximations to a point in a Hilbert space from a polytope, i.e., the 
convex hull of a finite set of points. 



2 Visibility from Convex Sets 

The first obvious consequence of the definition of visibility is the following. 

Lemma 2.1 Let C be a closed convex set in X. If x G C, then Vc(x) = {x}. 

This lemma shows that the most interesting case is when x G X \ C and the main results to 
follow actually require this condition as part of their hypotheses. Indeed, when x C, there 
are additional useful criteria that characterize visible points. For any set C, let bdC denote 
the boundary of C . 

Unlike the metric projection, the visibility operator is never empty-valued. 

Lemma 2.2 Let C be a closed convex set in X . Then 

(1) Vc(x) 7^ for each x G X , and 

(2) V c (x) C bdC for each xeX\C. 
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Proof. (1) Let i6l. By Lemma 2.1 we may assume that x ^ C. Fix any y G C. Then 



the interval [x,y] contains points in C (e.g., y) and points not in C (e.g., x). Let 

A := sup{A G [0, 1] | Ax + (1 - A)y G C}. 

Since C is closed, it follows that vq := Aox + (1 — Xo)y G C. Hence Ao < 1, and [x, Vo) Pi C — 
{vq}. That is, v G Vc(x). 

(2) Fix any x G X \ C. To show that w G bdC for each v G Vc(x). If not, then there 
exists some v G Va(x) such that v E C \ bd C Hence t> is in the interior of C. Thus there 
must be a subinterval [v ,v] of the interval [x,t>] which lies in C. Hence [x,v] D C ^ {v}, a 
contradiction to v G Vc(x). ■ 

Lemma 2.3 (Characterization of visible points) Let C be a closed convex set in X , x G 
X \ C, and v G C. Then the following statements are equivalent: 

(1) v is visible to x with respect to C . 

(2) Ax + (1 - \)v i C for each < A < 1. 

(3) max{A G [0, 1] | Ax + (1 - \)v G C} = 0. 

Proof. (1) => (2). If (1) holds, then [z,u[n(7 = 0. Since [x,t»[= {Ax + (1 - X)v \ < 
A < 1}, (2) follows. 

(2) ^> (3). Since v G C, (3) is an obvious consequence of (2). 

(3) (1). If (3) holds, then [x,u[nC = 0. That is, u G V^(x). ■ 

Simple examples in the Euclidean plane (e.g., a box) show that although C is convex, 
Vc{x) is not convex in general. These simple examples also might seem to indicate that 
Vc(x) is always closed. However, the following example in 3 dimensions shows that this is 
false in general. 

Consider the subset of Euclidean 3-space ^(3) defined by 

C := (1, 0, 0) + cone {(1, a, 0) \ a 2 + (/3 - l) 2 < 1}. (2.1) 



Example 2.4 The set C defined by (2.1) is a closed convex subset of ^(3) such that ^ C 
and Vc{0) is not closed. 



Proof. The result is geometrically obvious (see Figure 2.1) by observing that the points 
(2, sint, 1 + cost) are in Vc(0) for each < t < n, but that the limit point (2, 0, 0) (as t — > it) 
is not. However, the formal proof of this fact is a bit lengthy. Clearly, ^ C since the first 
component of any element of C is at least 1. We first verify the following claim. 

Claim. The points v(t) := (2, sint, 1 + cost) are in Vc(0) for each < t < tt. 

Using the classical trig identity sin 2 t + cos 2 t = 1, it is clear that v{t) G C for each 
< t < 7r. To complete the proof of the claim, it is enough to show that [0,v(t)[nC = 
for each < t < it. By way of contradiction, suppose the claim is false. Then there exists 
< t < tt such that [0,f (t )[n C ^ 0. Since ^ C, it follows that there exists < A < 1 
such that Af (t ) G C . That is, 

A(2, sin t , 1 + cos t ) G C = (1, 0, 0) + cone {(1, a, 0) | a 2 + {(5 - l) 2 < 1} 

= (1, 0, 0) + U p > p{(l, a, p) | a 2 + {/3 - l) 2 < 1}. 
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Figure 2.1: The set C from Example 2.4. 



Since A sin to ^ 0, it follows that for some p > 0, 

A(2, sin t , 1 + cos t ) = (1, 0, 0) + p(l, a, (5) 
for some a and (3 such that 

a 2 + (/3-l) 2 < 1. 



By equating the corresponding components in (2.2), we obtain 

2A = 1 + p 

A sin t = P« 
A(cost + 1) = p(3 



From (2.4) is deduced that p = 2A — 1<2 — 1 = 1 and hence that 

< p < 1. 



(2.2) 
(2.3) 

(2.4) 

(2.5) 
(2.6) 

(2.7) 



Also, from (2.5) and (2.6) we deduce that a = psint and (5 = p(l + cost ), where p : = 
X/p. Substituting these values for a and (3 into (2.3), we deduce after some algebra that 
1 > 2p 2 (l + cos t ) — 2p(l + cos t ) + 1. Subtracting 1 from both sides of this inequality and 
then dividing both sides of the resulting inequality by the positive number 2p(l + cos to), we 
obtain p < 1, i.e., A < p. From (2.4), it follows that p > 1, which contradicts (2.7). This 
proves the Claim. 
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It remains to note that the limit point lim^^ v(t) = v(tt) = (2,0,0) is not in Vc(0). 
For this, it enough to note that [0,i>(7r)[nC 7^ 0. And for this, it suffices to show that 
(3/4)v(7r) G C. But 

| v (tt) = (^,0,0) =(1,0,0) + ^(1,0,0) ec. m 

The following simple fact will be useful to us. It shows that the visible set mapping 
Vc satisfies a translation property that is also satisfied by the (generally set-valued) metric 
projection Pc- 



Lemma 2.5 Let C be a closed convex set and x, y E X. Then 



V c (x) = V c+ y(x + y)-y. (2.8) 

Proof. Let v E C. Note that v E V c (x) <^> [x,v{nC = $ O [x + y, v + y[ D (C + y) = 
v + y EV c+y (x + y) O v EV c+y (x + y) -y. ■ 

It is natural to ask which closed convex sets C have the property that Vc(x) = C 
for each x ^ C. That is, for which sets is the whole set visible to any point outside the 
set? The next result shows that this is precisely the class of affine sets. Recall that a 
set A is affine if the line through each pair of points in A lies in A. That is, if the line 
aff {di, 02} := {acicii + «20.2 | «i + «2 = 1} C A for each pair ai, 02 £ A. Equivalently, A is 
affine if and only if A = M + a for some (unique) linear subspace M (namely, M = A — A) 
and (any) a E A. Finally, the affine hull of a set C, aff (C), is the intersection of all affine 
sets which contain C. As is well-known, 



aff (C) = < otj-arj J finite, otj = 1, Xj E C > 



(2.9) 



Proposition 2.6 Le£ C be a closed convex set in X. Then the following statements are 
equivalent: 

(1) C is affine. 

(2) Vb(x) = C /or each xEX\C. 

Proof. (1) =4> (2). Let us assume first that C = M is actually a subspace, i.e., that 
E C. Fix any x £ M. Since Vm(^) C M, it suffices to show that M C Vm(x). To this 
end, let m E M. If m £ Vm{x), then [x,m[nM 7^ 0. Hence there exists < A < 1 such 
that Ax + (1 — A)m G M. Since m E M, this implies that Ax G M and hence x G M, a 
contradiction. This proves (2) in case C is a subspace. 

In general, suppose C is affine. Then C = M + c for some subspace M and c G C. For 



any x E X \ C, we see that x — c ^ M and by the above proof and Lemma 2.5 we obtain 

V c (x) = Vm +c (x) = Vm(x -c) + c = M + c = C. 
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(2) =>> (1). Assume (2) holds. If C is not affine, then there exist distinct points Ci,C2 in 
C such that aff {01,02} (£ C. Since C is closed convex and aff {01,02} is a line, it follows 
that either aff {01,02} D C — [2/1,2/2] or aff {01,02} PI C — y% + {p(j/2 — 2/1) | p > 0} for 
some distinct points 2/1, 2/2 in C- In either case, it is easy to verify that x := 2yi — y 2 £ C. 
Also, 2/1 = \x + \y 2 G [x,y 2 [nC, which proves that 2/2 ^ ^(x) and hence contradicts the 
hypothesis that Vc{x) = C. Thus C must be affine. ■ 

Definition 2.7 Lei C be a closed convex subset of X . For any point y G X , we define the 
translated cone C y of C by 

C y : = cone (C - y) + y. 
Some basic facts about the translated cone follow. 

Lemma 2.8 Let C be a closed convex set in X. Then the following statements hold: 

(1) C y D C for each y G X. 

(2) The set cone (C — y), and hence also C y , is not closed in general. 

(3) If y G C and the set cone (C — y) is closed, then C y = Tc(y) + y, where Tc(y) is the 
tangent cone to C at y. 

Proof. (1) C y = cone (C-y)+yDC-y + y = C. 

(2) Consider the closed ball C of radius one in the Euclidean plane centered at the point 
(0, 1) and let y denote the origin (0, 0). Then C y is the open upper half-plane plus the origin, 
which is not closed. 

(3) This follows since the definition of the tangent cone to C at the point y G C is given 
by T c (y) = cone(C - y) (see, e.g., P p. 100]). ■ 

One can also characterize the visible points via the translated cone. 

Lemma 2.9 Let C be a closed convex set in X, x G X \ C , and v G C . Then v G Va(x) if 
and only if x ^ C v . Equivalently, v fiVc(x) if and only if x G C v . 

Proof. If v ^ Vc(x), then [x,f[flC 7^ 0. Thus there exists < A < 1 such that 
y := Xx + (1 — X)v G C. Hence x — v — (1/X)(y — v) G cone (C — v) and therefore x G C v . 

Conversely, if x G C v , then there exist p > and y G C such that x = p(y — v ) + v = 
py + (1 — p)v. If p < 1, then x, being a convex combination of two points in C, must lie in 
C, a contradiction. It follows that p > 1 and y = (l/p)x + ((p — l)/p)v G [i,t)[nC. Thus 



[x,v[nC ^ 0, and so^ V c (x) by (1.1). 



The following proposition shows that the translated cones of C form the external building 
blocks for C. 

Proposition 2.10 Let C be a closed convex set in X . Then 

n c y =f]c y =f]c y =c. 

y&,AC y&C yeX 
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Proof. By Lemma 2.8, n y& xC y 3 C. Thus to complete the proof, it suffices to show 



that Dy^bdcCy C C. If not, then there exists x G r\ ye bdcC y \ C. Thus x G C y \ C for each 



y G bdC. By Lemma 2.9 y £ Vb(a;) for all y G bdC. But Vb(s) C bdC by Lemma UM2) 



This shows that Vc(x) = 0, which contradicts Lemma 2.2| (1 



A somewhat deeper characterization of visible points is available by using the strong 
separation theorem. Recall that two sets C% and C 2 in the normed linear space X can be 
strongly separated by a continuous linear functional x* G X* if 

supx*(y) < inf x*(z). (2.10) 
j/eCi zeC< 2 

One can also interpret strong separation geometrically. Suppose C\ and C 2 are strongly 



separated by the functional x* such that (2.10) holds. Let b be any scalar such that 



sup x*(y) < b < inf x*(z). 

Define the hyperplane H and the (open) half-spaces H + and H~ by 

H :={yeX\ x*(y) = b}, H + := {y G X \ x\y) > 6}, and 
H := {y G X \ x\y) < b}. 

(Note that H, H~ , and H + are disjoint sets such that X = H U U H + .) Then i7 is said 
to strongly separate the sets C\ and C 2 in the sense that C\ C H U C 2 C H U H + , and 
(at least) one of the sets Ci or C*2 is disjoint from iif. 

Fact 2.11 (Strong Separation Theorem; see jH Theorem V.2.10, p. 417]) Let C\ and C 2 be 

two disjoint closed convex sets in X, one of which is compact. Then the sets can be strongly 
separated by a continuous linear functional. 

Definition 2.12 Let K be a convex subset of X . A point e G K is called an extreme point 
of K if ki G K , k 2 G K , < A < 1 , and e = Afci + (1 — X)k 2 imply that k\ — k 2 — e. The 
set of extreme points of K is denoted by ext K . 

The following fact is well-known (see, e.g., jH pp. 439-440]), and it will be needed in this 
section and the next. 

Fact 2.13 (Krein-Milman) Let K be a nonempty compact convex subset of X . Then: 

(1) K has extreme points and K is the closed convex hull of its extreme points: K = 
conv (ext K) . 

(2) If x* G X* , then x* attains its maximum (resp., minimum) value over K at an extreme 
point of K. 

Theorem 2.14 (Another characterization of visible points) Let C be a closed convex subset 
of X, x G X\C, and v G C . Then the following statements are equivalent: 
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(1) v is visible to x with respect to C ; 



(2) For each point y e\x,v[, there exists a functional x* G X* that strongly separates [x,y] 
and C , and x*(y) = max^^] x*(z); 

(3) For each point y e]x, v[, there exists a hyperplane H = H y that contains y and strongly 
separates [x,y] and C . 

Proof. (1) =>- (2). Suppose v is visible to x from C. Then [x,u[nC = 0. In particular, 
for each y G [x,v[, [x,y] PI C C [s,i)[nC = 0. Thus [x,y] and C are disjoint closed convex 



sets, and [x,y] is compact. By Fact 2.11, there exists x* G X* such that 



b:= sup x*(z) < inf x*(c). (2.11) 

z£[x,y] ceC " 

To verify (2), it remains to show that x*(y) = b. If x = y, this is clear. Thus we 



may assume that x ^ y. Since [x, y] is compact, the supremum on the left side of (2.11) 
is attained. Further, this maximum must be attained at an extreme point of [x, y] by Fact 
2.13[ 2). Since x and y are the only two extreme points of [x,y], we must have x*(x) = b or 



x*(y) = b. 

Suppose x*(x) = b. Since v G C, we have x*(v) > b by (2.11). Since y e]x,v[, there 
exists < A < 1 such that y — Xx + (1 — X)v. Then 

x *( y ) = Xx*{x) + (1 - X)x*(v) > Xb + (1 - A)6 = b, 

which contradicts the definition of b. Thus the condition x*(x) = b is not possible, and we 
must have that x*(y) = b, which verifies (2). 

(2) =^ (3). Assume (2) holds. Let y e]x,v[. Choose x* G X* as in (2), and define 
H := {z G X | x*(z) = 6}, where b = maxgg^y] x*{z). Then H strongly separates [x,y] and 
C, x*(y) = b, and so y G H. Thus (3) holds. 

(3) ^> (1). Suppose (3) holds but (1) fails. Then [x,f[flC ^ 0. Choose any y e]x,v[C\C. 
By (3), there is a hyperplane H that strongly separates [x, y] and C such that y G H. Writing 
H = {z G X | x*(z) = b}, we see that [x, y] C {z G X \ x*(z) < 6}, C C {z G X x*(z) > 6}, 
and = 6. But y G C and hence #*(?/) > 6, which is a contradiction. ■ 

3 Visibility and Best Approximation 

In this section we explore the connection between visibility and best approximation. The 
first such result states that the set of best approximations to x from C is always contained 
in the set of visible points to x with respect to C. 

Lemma 3.1 Let C be a closed convex subset of X. Then Pc{x) C Vc(x) for each x G X. 
Proof. The result is trivial if Pc{%) = 0- If x G C, then clearly Pc{%) = {%} and 



Vc(x) = {x} by Lemma 2.1 
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Now suppose x G X \ C and let x G Pc(x). Then x G C so x ^ x. If [x, x [ fl C ^ 0, 
then there exists < A < 1 such that x\ := Ax + (1 — A)xo G C. Hence 

||x — x\\\ = 11(1 — X)(x — x )|| = (1 — A)||x — x || < \\x — xq\\, 

which is a contradiction to x being a closest point in C to x. This shows that [x, x [ fl C = 
and hence that x G Vc(x). ■ 

Recall that if X is a strictly convex reflexive Banach space, then each closed convex subset 
C is Chebyshev (see, e.g, [7]). That is, for each x G X, there is a unique best approximation 
(i.e., nearest point) Pc{x) to x from C. As is well-known, the most important example of a 
strictly convex reflexive Banach space is a Hilbert space. It is convenient to use the following 
notation. If S is any subset of X, then the convex hull of S is denoted by conv (S) and the 
closed convex hull of 5 is denoted by conv (5"). 

Another such relationship between visibility and best approximation is the following. 

Lemma 3.2 Let X be a strictly convex reflexive Banach space and C a closed convex subset 
of X. Then C is a Chebyshev set and if x G X \ C , then 

P C (x) = P Vc{x )(x) = Pcorw Vc {x){x). (3.1) 



Proof. By Lemma 3.1, Pc(x) G Vc(x). Since Vc(x) C convVc(x) C C, it follows that 



Pc(x) G Pv c ( x )(x) and Pc(x) = Pcmwv c (x)( x )- Thus Pv c .( x )(x) is a singleton and (3.1) holds. 



While the Krein-Milman theorem (Fact 2.13[ 1)) shows that the set of extreme points 



ext C of a compact convex set C form the internal building blocks of C, the next result 
shows that the sets C e , where e G extC, form the external building blocks for C. It is a 



sharpening of Proposition 2.10 in the special case when the closed convex set C is actually 
compact. 

Theorem 3.3 Let C be a compact convex set in X. Then 

C = f|{C e I e G ext C} = p|{q, | y G C}. (3.2) 
Proof. Using Proposition |2.10| it suffices to show that fl{C e | e G extC} C C. If not, 



then there exists x G C\{C e \ e G ext C} \ C. By Fact 2.11 , there exists x* G X* such that 



s := supx*(c) < x*(x). (3.3) 
cec 

By compactness of C, the supremum of x* over C is attained, i.e., there exists Co G C such 
that x*(co) = s. As is easily verified, the set 

C = Cn {y G X I x*(y) = s} (3.4) 

is extremal in C, has extreme points (since it is a closed, hence compact, convex subset of 
C), and each extreme point of C is an extreme point of C (see, e.g., jH pp 439-440]). Choose 
any extreme point c in C. Then c G ext C. Also, x G Cg = cone (C — c) + c implies that 
x = p(c — c) + c for some p > and c G C (see, e.g., [3, Theorem 4.4(5), p. 45]). Hence 

s < x*(x) = p[x*(c) — x*(c)] + x*(c) < x*(c) = s, 

which is impossible. This contradiction completes the proof. ■ 
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Proposition 3.4 Let C be a closed convex set in X , x G X\C , and let x$ G C be a proper 
convex combination of points ei in C . That is, xo = f or some Aj > with Yli A» = 1. 

If xq is visible to x with respect to C, then each Ci is also visible to x. 

Proof. Ilk — 1 the result is trivial. Assume that k = 2. (We will reduce the general case 
to this case.) 

If the result were false, then we may assume without loss of generality that e± is not visible 
to x. Thus ]x, ei[D C ^ 0. Hence there exists < p < 1 such that x\ := px + (l — p)e\ G C. 
It follows that 

e\ = x% — — x. (3.5) 

1 — p 1 — p 

Next consider, for each p G [0, 1], the expression x(p) := px\ + (1 — p)ei- Clearly, x(p) G C 
for all such p since both x% and C2 are in C and C is convex. Omitting some simple algebra, 
we deduce that 

x(p) = p[px + (1 - ii)ei] + (1 - p)e 2 

= ppx + (1 - pp)x + p(l - /i)ei + (1 - p)e 2 - (1 - pp)x 

= ppx + (1 - pp)x + [p(l — p, + Ai/i) - Ai]ei + [— p(l - jU + Aip) + Ai]e 2 . 

In particular, if we choose 

p:=1 X h-, (3-6) 

1 — p + Aip 

it is not hard to check that < p < 1. Thus < pp < 1 and 

x(p) = ppx + (1 — pp)xq G C. (3.7) 

This proves that x(p) E]x,xo[r\C, which contradicts the fact that xq is visible to x. 

Finally, consider the case when k > 3. If the result were false, then without loss of 
generality, we may assume that e\ fails to be visible to x. Write 

xo = Aiei + p^ — ei, 

where p := = 1 — Then < p < 1, Ai = 1 — p, and Xq — (1 — p)e\ + py, where 

y = 77 e i ^ C by convexity. By the case when k = 2 that we proved above, we get that 
ei (as well as y) is visible to x, which is a contradiction. ■ 

Remark 3.5 Simple examples in the plane (e.g., a triangle) show that the converse to Propo- 
sition \3^4 is false/ That is, one could have a closed convex set C , a point x G X \ C , points 
G Vc(x) for i = 1, 2, . . . , k, k > 2, but xq = \ Yli Gi E C is not visible to x. 

Theorem 3.6 Let C be a closed and bounded convex set in an n-dimensional normed linear 
space X such that ext C is closed. Then 

( k k ~\ 

C=\^\ i e i 1 < k < Ti + l, Ai > 0, J^Ai = 1, ei G extC I . (3.8) 
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Further, let x G X\C . Then each point in Pc{x) is a proper convex combination of no more 
than n + 1 extreme points of C all of which are visible to x with respect to C . That is, 



P c {x) C \ J2 X i e i 1 < k < n + I, Aj > 0, ^ Aj = 1, ej G (extC) n V c {x) 



(3.9) 



Proof. Since closed and bounded sets in finite-dimensional spaces are compact, Fact 
2.13[ 1) implies that C = conv (ext C). By Caratheodory's theorem (see, e.g., [21 p. 17]), 
each point in conv (ext C) may be expressed as a convex combination of at most n + 1 points 
of ext C. That is, 



' n+1 



n+1 



conv (ext C) — < Ajej ej G ext C, Aj > 0, Aj = 1 



(3.10) 



We will show that conv (ext C) is closed, and hence that C = conv (ext C). To this end, let 
(xfc) be a sequence in conv (ext C) such that Xk —> x. It suffices to show that x G conv (ext C). 
We have that xj~ = Y^7=i ^ki^ki for some e^ G ext C, A^j > 0, and Afcj = 1 for each k. 

Since C is compact, and the X ki are bounded, it follows that by passing to a subsequence 
that Cki — > ej and Afcj — > Aj for each i. Since ext C is closed, ej G ext C. Further, it 

limt. 1 = 1. Thus, 



easy to see that Aj > for each i and X^=i = nm fc SiLi ^fc« 
x = Yli +1 ^i e i e conv (ext C) and conv (ext C) is closed. This proves (3.8). 

Now let x G X \ C. By the first part, each point of Pc{%) is in conv (ext C). By Lemmas 



3.4 and 3.1, (3.9) follows 



4 Best Approximation from a Simplex 

In this section we investigate the problem of finding best approximations from a polytope, 
i.e., the convex hull of a finite number of points in a Hilbert space X. Such sets are compact 
(because they are closed and bounded in a finite-dimensional subspace). 

Let E := {eo, e±, . . . , e n } be a set of n + 1 points in X that is affinely independent, i.e., 
{ei — eo, e2 — eo, • • • , e n — eo} is linearly independent. This implies that each point in the 
convex hull C = conv {eo, e\, . . . , e n } has a unique representation as a convex combination 
of the points of E. In this case, C is also called an n-dimensional simplex with vertices ej, 
since the dimension of the affine hull aff (C) of C is n. Further, the relative interior of C, 
that is, the interior of C relative to aff (C), is given by 

ri(C):= J^Vil Ai>0, X) Ai = 1 [- ( 41 ) 
It follows that the relative boundary of C, rbd (C) := C \ ri (C), is given by 

{n n >. 

^ A,ej | Aj > 0, ^ X i = x > X j = for at least one j (■ ( 4 - 2 ) 
i=0 i=0 ' 

(See [SI p. 44ff] and jSJ p. 7ff] for more detail and proofs about the facts stated in this 
paragraph.) 



11 



We consider sets of affinely independent points, since this case captures the essence of 
our constructions and arguments. Convex hulls of n affinely dependent points (i.e., finite 
point sets that are not affinely independent) can be split into the union of a finite number 
of convex hulls of subsets of affinely independent points. Thus the problem of finding best 
approximation from the convex hull of an affinely dependent set of points can be reduced to 
a finite number of problems analogous to the one that we consider below in detail. 

Under the above hypothesis that C is an n-dimensional simplex, we wish to 
compute Pc(x) for any x£l. 

We give an explicit formula for Pc{x) in the case when n — 1; that is, when C = [eo, e\] is 
a line segment. Then, by a recursive argument, we will indicate how to compute Pc{x) when 
C is an n-dimensional simplex for any n > 2. First we recall that the truncation function 
[■]q is defined on the set of real numbers by 

( if a < 
[a] J = < a if < a < 1 
{ 1 if a > 1. 

(Note that in the space X = R, [a] J = P[ 0> i](a) for all a G R.) 

Proposition 4.1 Let C = conv{eo,ei} = [eo,ei] be a 1- dimensional simplex. Then, for 
each x G X, 

(x - e ,ei - e ) n 



Pcix) = e + 



ei - e 



(ei-eo). (4.3) 



J o 



Proof. Let a := (x — e ,ei — e )||ei — e || -2 and c := e + [a]o( e i — e o)- Then c G C, 
and by the well-known characterization of best approximations from convex sets in Hilbert 
space (see, e.g., [31 p. 43]) it suffices to show that 

(x — Co, y — c ) < for each y G C. (4.4) 

Let y G C '. Then y = e + A(ei — e ) for some A G [0, 1]. Hence 

(x- c , ?/ -c ) = (x-e - [a]o(ei -e ),A(ei -e ) - [«]o(ei -e )) 
= (A - [a]o)[(x - e ,ei - e ) - [a]o||ei - e || 2 ] 
= (A- Ho)l|ei -e f [a- [a] J] . 

By considering the three possible cases: a < 0, a G [0, 1], and a > 1, it is easy to see that 



the last expression is always < 0. Hence (4.4) is verified. 



Before considering the cases when n > 2, let us first consider the problem of computing 
Pa{x) for any x G X, where A = aff C. 

Fact 4.2 Let C = conv{eo,ei, . . . ,e n } be an n-dimensional simplex, and let A = aff (C). 
For any x G X , we have 

n 

P A {x) = e + ^ a i( e i ~ e o)> ( 4 - 5 ) 
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where the scalars a.^ satisfy the "normal" equations: 

n 

atjjej - e , ej - e ) = (x - e , e» - e ) (z = 1, 2, . . . , n). (4.6) 

i=i 

The proof of this fact can be found e.g., in [1] p. 418] or P, p. 215]. Moreover, the 
"reduction principle" that was established in [HI p. 80] (where it was stated in the particular 
case of a subspace) can be easily extended to affine sets as follows. 

Fact 4.3 (Reduction Principle) Let C be a closed convex set in the Hilbert space X and let 
A — aff (C). Then Pc = Pc ° Pa- That is, for each x G X , 

P c (x) = P c (P A (x)) and d 2 (x, C) = d 2 (x, A) + d 2 (P A (x), C). 

We are going to use the Reduction Principle as follows. We assume that it is straight- 
forward to find the best approximation to any x in the set A = aff C, where C is an 
n-dimensional simplex (since it involves only solving a linear system of n equations in n 



unknowns by Fact 4.2). The Reduction Principle states that (by replacing x with Pa(x) if 
necessary) we may as well assume that our point x is in A to begin with, and we shall do 
this in what follows. We will see that the case when n = 2 can be reduced to the case when 



n = 1 (i.e., Proposition 4.1 above) for which there is an explicit formula. 



Proposition 4.4 Let C = conv {eo, e±, e^\ be a 2- dimensional simplex. Then for each x G 
aff (C), either x G C in which case Pc{x) = x, or x ^ C , in which case 

Pc(x) = P[e i ,e i+1 ]( x ) f or an U i {0, 1,2} that satisfies (4.7) 
\\x - P [ei>ei+l] (x)\\ = nun ||x - P [ej ^ +l] (x)\\. (4.8) 

(Here e 3 := e .) 

Proof. If x G C, then obviously Pc(x) = x. Thus we can assume that x G aff (C) \ C . 
It follows that Pc(x) must lie on rbdC = Uf =0 [ej, ej+i]. That is, Po(x) G [e», ej+i] for some 
% = 0, 1, or 2. 

Claim: Pc(x) = P[ euei+1 ](x) for each i such that Pc(x) G [ej,e i+ i]. 
To see this, we observe that since Pc(x) G [e*, e^+i], we have 

||x - Pc(x)\\ = d(x,C) < d(x, [e h e l+ i]) < \\x - Pc(x)\\ 

which implies that ||x — -P[ e ,,e i+1 ](^)|| = d(x, [e^ e^+i]) = \\x — Pc(x) \\. By uniqueness of best 
approximations from convex sets in Hilbert space, the claim is proved. 

If k is any index such that \\x — P[ efc)efc+1 ](x)|| = min, \\x — P[ e . e . +1 ](x)||, then it is clear 
that we must have Pc(x) = P[ ek ,e k +i]( x )- ' 



Now it appears to be straightforward to apply the idea of Proposition 4.4 to any n- 
dimensional simplex to describe how to determine Pc(x). 
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Let C = conv {eo, ei, . . . , e n } be an n-dimensional simplex in X and x G aff (C). If 
x G C , we have Pc{x) = x. Thus we may assume that x G aff (C) \ C. It follows that 



Pc(%) £ rbd(C). From (4.2) we see 



rbd (C) = S 5^ A^e,; | Aj > 0, ^ A, = 1, Xj = for some j >. (4.9) 
^ o J 

Since every y G rbd C is contained in (at least) one of the sets 

C,- := | A^ | Aj > for all i, Xj = 0, and ^A, = 1 I, (4.10) 

m=o o ' 

it follows that 

n 

rbdC=|JC i . (4.11) 

3=0 

Further, each Cj is a simplex of dimension n — 1 in C, Pc{ x ) £ Cj fo r at least one j, and 
for all such j, we have that 

\\x-Pc(x)\\=d(x,C) < \\x-P Cj (x)\\ =d{x,C j ) < \\x-P c {x)\\. 

This implies that equality holds throughout these inequalities, and hence by the uniqueness of 
best approximations, we have Pc(x) = Pc^x). If J = {j \ \\x—P Cj (x)\\ = mim \\x— Pc^x)^, 
then clearly Pc(x) = Pc '■{%) f° r each j G J. 

This discussion suggests the following recursive algorithm for computing Pc{%) when 
C = conv{eo,ei,. . . ,e n } is an n-dimensional simplex. Let Cj be the (n — l)-dimensional 



simplices as defined in (4.10). Let A = aff C, Aj = aff Cj for each j = 0, 1, . . . , n, x G A\C, 
and Xj = Pc (xj) for all j. The algorithm below defines a function P(n,x,C) which takes 
as input n and x and the set C and returns the best approximation Pq(x). 

Algorithm. 



(1) If n = 1, then find P(l,x,C) by using the formula given in Proposition 4.1 

(2) If n > 1, then compute Xj = Pa j (x) and Pc 3 (xj) = P(n — 1, Xj, Cj) for j — 0, 1, . . . , n. 

(3) Set P c {x) = Pcj{xj) for any j G argmin fe ||x fc - P Ck (x k )\\. 
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